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■ ' ^ This is \'he third of four reports of the interactive 

Group Modeling project — an undertaking designed to extend group 
cosaunication through cOiputer* to support, the tore taSk-focused 
coasunication required bt thostf ^Jbullding computer aodels. The report 
focuses on the HOB systes-^ajtystes tjiat facilitates coBiunication in 
four aodes: cosputer conf&m^k, shared visual spaces, prograa 
workspaces, and docusent >^ork spaces. Specifically, the report 
identifies potential voids of the HOB systes in the aodj^ling process 
and offers a prelisinary taxo^ciy for^ mapping its uses. (FL) 
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HUB; A Nevi^nvlronment for Modeling 

HUB^is ready. The final paiyes of code have been written/ isqplemented, 
and debugcpad. The Vser Guide islback from the printer's. The only ques- 
tion that remains is: What shoulJl we do wil^h HUB now that we've got it?- 

HUB was designed to create a new environment for large-scale coinputer 
modeling, it; is, ^bove dll, an environment for group cqmnvnidiition. Like 
>a«5^oinputer conferencing 'feystem, the eirphasis is on providing ij^place" that 
a *qr|^\^p of people dan share— ^and a set of procedures that allow them to ac*- 
oomplish tasks, jointly rather than individually. . In HUB actiyities, there 
are transcripts to vhich all members of the group can cpntribute; there are 
opportunities to watch a group member rxin a program or make editorial cljanges 
^in ^a document — and to discuss the best way to accomplish these tasks. The 
HUB program also provides other groutt^oriented information such as network • 
patterns or simply status reports ojS how up-to-datp\each member of the group 
is. ^ ^ ^ 

Beyond its emphasis on grovp comm^nication, the HUB system emphasizes 
structured co/nmuni cation— and a particular structure at that. The HUB en- 
viron^nent is organized into activities, and different activities take place 
in different Settings. Just as we wouldn't expect a basketball team to play 
basketball in their strategy room, we don't expect modelers to exercise their 
model, in an electronic conference room. That's why HUB has several kipds of 
activities. If modelers want to discuss basic modeling objectives and 
stria tegies or coordinate their work over several weeks or months, then the 
relatively unstructurtd env^onment of a PLANET conference may J)e most appro^ 
priate. But if they want toVrite a program or runr it urtder different con-* 
ditions, they can move to a program workspace, which is designed for jUgt 
that purppse. Or if they want to write a preliminary ^report to. the client 
or dev.elop a guide for maintaining and modifying a modal, they can work in 
a dooinpnt workspace. Of coursa, all of these activities are related, so Ijb . 
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should be easy to move both people and infonnatioji among the varioue activi- 
ties^ This Is the goal of HUB— to provide eaiby access to different communi- 
cations settings "un^er the same roof*" * ^ 

A third characteristic of the HUB environment is the value placed on 
interaction^ HUb could be used in a lecture- type style with one pecspn 
generatitig most of the information and the rest of the grot^p siinply "viewing" 
^this informati9n* But HUB has been designed to facilitate interaction as 
much ap possible. An exairple is the program workspace. In a program work- 
space, only one person cdn rvin a program at a time* But dufing the course 

^ ot the run, other group* members (see the interaction between persons and pro-- 
gram) can send messages to the person running the program; and that person can 
send messages to the group* So the group can make joint decisions about the 

^program run. ' . . 

Tlie HUB environment also supports text-abased communication. Like other 
computer-based communication media ^ HUB requires the use of typed words to 
express ideas, opinions, and social meaning. But it also goes further than 
text-based communication to provide possibilities for numerical and tabular 
information. . That is, through the program workspaate — and specifically / 
through the use of programs — people can communica/e in a language^other 
than their spoken language. In limited ways, tJ^ey can also communicate 
graphically. (This capability for graphic coitimunitation will be greatly 
enhanced wl^en the shared visual space is iitplemepted in HUB.*) 

Another feature of the HUB environment is the pertOanenc^ of the comnu- 
nication. HUB maintains transcripts of the communication and work done in 

V 

all of the types of activities. Thus, documentation — a problem that plagues 
modeling efforts — becomes partially automatic. Further, the document work- 
space supports the joint preparation of formal reports, which can draw on 
the material recorded in the other HUB activities..' Records can also be 
modified or stored in private files outside of the HUB system. 

This record of oommunication, contoined wit;h HUB's ability to recognize 
wrta has seen what inflation in an activity, creates a flexibility of time 
in comnunicating via HUB. As in most c&mputer conferencing systems. 



*For a description of the plans for the shared visual space , see Hubert 
Lipinski, Robert P^rtlminei:^ and Kathleen S. Vian, InteT&ctive Group Modeling, 
■ ^ Part If Extending Group Commniaation through Computers, Report R-44. 
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coimmmication cam be synchronous^ orr asynchronous. Members of a* modeling 
te^am can work when It Is ipost convenient for them; they* can also catch up ' 
or comment on the work of others at their convenience. For example, although' 
they may not want to stand arotlnd while one of their colleagues is changing 
the A-matrix values in a KSIM prograiur* they (could want tp makje suggestions 
about what those changes might be. And they certainly Would like to see the 
.Results r conment on th^, and possibly try out changes of their own. They 
ceui do all of these things asynchronously — when they are online alone. 

Finally r the HUB environment is a geographically dispersed environment 
that encoyrages use of remote resources — both human and computer resources. 
Since HUB is impl^ented on a network, modelers using the system can gain 
access to a wiSe variety o£ programs and data bases On a variety of compu-- 
ters without having to leave a single program workspace — emd without having * 
to leave the [coimunlcatlon capabilities of HUB. Furthermore, the modeling 
team can include people who are geographically separated. HllB not only allows 
them to coordinate their work- with each other, but also allows them actually 
to work together. 

. ' All of these characteristics create a working environment that 'is dif- 
ferent from the ones in which models have been designed, buil€, tested, and 
presented in the past. It would not be surprising, then, to find that einode 
developed using the HUB system are different from other ntodels or that the 
way they are developed differs from the ways they have traditionally "been 
developed. The quei3tion that we posed earlier, though, still remains. How 
should HUB' be used? What kinds of modeling efforts are most likely to bene- 
fit from the features found in the HUB environment? How might they be best 
organized? And what will be HUB*s impacts on the model itself? 

In the following pages, we explore the possibilities for us^ing HUB in 
the modeling pro^ss. We have selected four examples of premising uses — 
not uses that have beeh tried and tested yet but uses that we think should 
be. 



*See]>Hubert LipinsJfrL and John Tydeman', "Cross-Impact Analysis— Extended 
>!SlM," Futures, vol. 11, no. 2, April 1979. ' . 
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Promising Uses and Possible Impacts 



To €malyze amy modeling effort, we start by asking three single questions: 

What Is beljxg modeled? 1| 
Why Is It being modeled? 
' ' How should It be modeled? 

, . Every modeling team has answers to these questions, whether or not Its 
members eyer state them explicitly (and whether or not the answers they state 

. eacpllcltly are the real answers))* But for different modeling efforts, one 
or another of these questions will be th6 most Important. Some efforts will 
focus on clarifying the nature ^f the system to be modeled without question- 

. Ing its possible end uses and wi\^ut any conihitment to any particular mode\^ 
Ing approach. Others will start with an 6b jective~very often an organiza- 
tional rather, them analytical objective — and des^lsthe model as urell as the 
modeling process to meet that objective. Still others will start with a 
methodological question eund select the 'Vhat" and Vhy" of the model to test 
that methodological! question. 

» 

In looking 9ox promising uses of the HUB system, w6 have fought a range ^ 
of possibilities that (1) emphasize different questions as starting points 
and (2) might really benefit from one or more of the* HUB features. In this ^ 
chapter, we describe four of these possibilities. Hxe first is one in which 
the question of 'Vhat" is foremost; in fafftt, the purpose of thj modeling 
effort is to define vfhat the problem is. Htxe second and third possible uses 
are ••why" examples. The sec'ond is an effort to use modeling specifically to 
iityprove conwunication amdng actors in a situation. The third also focuHes 
on a communication needt ^ the need for policymakers to have better tools to 
help them in decision-making, ihis emphasis on applied use of the model 
raises one of the most trq|blesoih6 problems in model ing Ih^agemen t--* 
documentation. Finally, the fourth possibility is a ••how'^: ekanqple. It is , 
primarily a methodological study concerned with ways of linking models to-* 
ge^thar. 



SCENARIO It WHAT ON EARTH IS THE PROBLEM? 



Things are a messl 



There are gas lines f and meat prices k&ep climbing. The America!} family 
is falling apart. Television is boring, and nothing new is happening in • 
music. It's July, ana ihe\otholes in the streets from lash winter still 
haven't been repaired.^ 




This is the enyitemttent in wlUch most decision-makpr^ have to operate 
today. Soinetimesriit is relatively iBasy to isolate the problem to be a^- 
dressed by the decision-maker. But aften "the prpblem" ii so cx)mplex and 
many-sifted that the most pressing problem is to figure out what the problem 
is. 



This process of problem formulation or definition is itself a process 
lling. It is a process of generating issues or variables that con- 
the problem space and of identifying relationships. among these vari- 
Les. unlike many modeling problems, however, problem formulation stresses 
of the list of variables, since the objective is to construct 
>sdible picture of the problem situation. And the specification 
of f3Sk:ions>iips among variables is not so much to predict outcome^ or even ^ 
to understand the operation of tha syiStem, byt rather to gain ari apprecia- 
tion of *the diversity of perspectives ahout the problem situation. The prob- 
lem formulation that emerges out of such j>roces8 is likely to be seen as 
more relevant to decisions of many actors than a problem statement that 
is made prematurely or arbitrarily.* . ^ * 




Such a problofln^ormulation process emphasizes grotp communication; to 
Mpand issues ajid obtain a divers^i^ry o^f perspectives Requires irput from 
iMny people. It also require id. some structured commudiication ixi order to 
organise the many variables and^perspectives. For these reasons, we think 
HUB has eome promieing ^^ypplications, in. problem formulation, as euggested by 
the following scenario • r ' 



The sltuaUon is this: a state agency has contracte<i' with a consulting 
^firm to aid it in defining what kind of research would be most useful in 
.planning not only its budget and staffing, but also possible changes in its 
services and overall organization over the next /ive years. The prgject has 
the enthusiastic support^ of a high-ranking official Jn the agency ', who has 
convinced members of all of the regional offices to participate in, the scGdy. 
The. charge to the client is to develop' an, effective procedure for them to 
joinhly define their research needs. The agency doesn't want the process 
to take a long time— six weeks at most^-or to be too disruptive of the day- 
/to-day responsibilities of the regional participants. 

This is the way they might use >HUB: the consulting firm begins witlka 
quick series of face-to-face interviews with each of the participants f^om 
the agency in order to gather the^ impressions of the major issues the 
agency will need to address over ^ next five years. The interviews also 
enable the consultants to get to know the participants. Next, they estab- 
lish a PLANET conference in HUB to feed back the issues ' (anonymously) to 
the entire group: Over the next week, the group discussed these issues and 
finds that, as a result^of the discussion', the nuniber of issues has more 
than doubled. At the same time, the. consulting group has interviewed repre- 
sentatives "of several ovf^ide groups with an interest in the agency, iden- " 
tiffing issues that they feel are arijclal .for the near .future. These issiies 

are also presented and discussed in the PLANET conference, 

J 

From this initial list of issues, the cohsulting team selects a number 
of variables to be struqtured in a forecasting model. The team sets up the 
program for the model in a program workspace, demonstrates its use, and 
encourages the rest of the group to experiment with different values and 
relationships for the variables as well as with different variables. Some - 
of them do this Jointly, some do it individually, and others just watch. 
This generates discussion, b^th in the program workspace in comectlon with 
specific runs and in the PLANET conference that is still runniri^i^^ ' 
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At tile hegiiiningr of the fifth week, the consulting team J^nvitea the 
participants to begin to list their ideas about research needs, ' The team 

* 

takes th±s joint list, together with a preliminarg^urvey of related ' research 
already complet^ed, to a face-to-face meeting wiph the group at the end of the 
'sixth week. . < 



*• 



An obvious benefit of HUB in this situation is a practical one: a group 
of people in several different locations can work jointly on a problem over a 
period of six weeks without severely disri^ting their work schedules. From 
tJiis prac^cal benefit flow the intellectual benefits of more time to re- 
fleet on the work being don^, more immediate responses than might be possible 
with a series of face-to-face meetings, and the opportunity ^f or an i^iterplay 
between the ideas being discussed in the conference gnd immediate events tak- 
ing place on the "home turf" of each, of the participants^ 

But more significan^t is the capability of HUB to provide a focus and 
structure for comparing perceptions and assumptions about the problem situa- 
tion for the agency.' In this case, thie structure^ was a forecasting program. * 

We expect that the various runs of the program would bring a number of in- 

- • » ■ . ^ 

quiries about the rationale, about tile* assumptions behind particular choices 
of variables ior values foj* variables* Similarly, the results of the runs 
shoxild prompt discussion of * various interpretations. Of course, 'they will 
moQt likely also lead to* some new learning about the users' environment — the 
prcigram can display relationships and consequences of relationships that are - ^ 

difficult to conceptualize in one's head. It might even produce some sur- 
prises that suggest enUrely new issues or ways of viewing the envirpmnent. 
The use of such programs in the context of group coimunicatigxy^eonld pxoduce 
intellectual insights as well as foster a ccinmon groyp understanding of th6 
progress being modeled. \ - - . ^ 



*For a summary of some of the structural nodeling tools from which such 
a program may be drawn, see George G. LendarisSind Wayne W. Wakeland, "Struc- 
tural Modeling — A Bird's Eye View," PortlaflKT ' 9Wh te University, Systems Science 
Program, February 1977. , 
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HUB offers some other minor benefits, in. this situation. For exanpO^e, 
its recordkeeping .capability ^would " allow th^. group to review ideas contin- 
uously— a cap<ibility that is -probiibly' useful in any brainstorming situatioi. ' ' 
Also, as used in this scenario, it provides* some initial anonymity, in the 
listing of issues,, and such anonymitjr can also promote less 'inhibited- parti- 
cipation in brainstorming. * ' ,* « 

At same Ume, though, we suspect that there are a number of things 
th^t could go wrong in this iiae of HUB.,, Problems of participation are most 
(likely. Using any computer conferencing system requires a commitment' to the 
group and a perceiyed need to conmiunicate . The opportunities for a l^ack of 
such conmitment seem plentiful in the situation we, have described, although 
it helps to have a high-ranking official fully behind the effort. But' be- 
yond the inherent passiveness of a computer-b^d system, the uae of any 
forecasting program may be intimidating to some iKero^rs of the team. The 
ability of the consulting team to tea*^h the groupVo use' the program is , ■ . 
critical; if some merobei^" feel unsure and insecure, they might sinply drop 
out or sabotage the whole confejrence in some' way. "Participatibn does not 
necessarily mean running the program, though. Some people may choose to/com- 
ment on^ runs and offer suggestions and .thus remain active participants with- ' 
out a«tually doing their own runs. 

Another potential problem is that< the discussion in* HUB is so diffs^eflt 
from, face-to- face^^ilhunicaUon that participants may^become f rustratei^ by a 
feeling of infoni^ion overload and be unable to extract any learning from 
the process.. The PLANET conference certainly has the capability to promote • 
mushrooming, nonsequential ideas— h^ce its value for brAinstopning. However, 
the group needs to be patient with this process. One consolation, of course, ' 
.is that subsequent runs of an interactive forecasUng program should help to ' 
structure some of those ideas. But what. if they don't? It is possible to 
imagine that the groi^ members ndaUlh^l en d uf^ going{,pff and running the 
program by themselves withbut el^ revising and corimtenting. on other runs. • 
Then they would not (ptily not knov(^ADWQt1^ were interpreting fhe relaUon- 
BhLpit they would not even know. wljaA runT^e others had seen. 



Finally, it way be difficult for the consulting t^iam*t;p find tbfe right 
level of control over the conference. On one hand, it would a -mistake 
for them to let a situation sud^ as the one we just noted ariser on the other. 

hand, a lot of CheSearn^n^ and communication will probably occ^xr a re- ^ 

r_ ■' • * . ■ ' ' ' •. • . 

suit qf ^e ^f reedorti for J^e group^membera to* explore the program woa^kepace 

' . . " • ^ . J)' ^ ^ * 

on their own. And ^i$ l^eedom '6ould, be a little threatening to the consult^ 
ing tetam, particularly If it .has. doj^bts about the value 9f its tt(«jrv*t:ontribu- 
tfon and the process it is^ prompting/,^ * * i . ' 

^ In the next tvo years, as we tesj: %iUB in situatiot)3 like' these, we will v. 

want to watch to, see i^ tfur antiQipated benefits- or problems emerge. We 
* » » >' » . 

VilJL w^t/to pay pa^rticUlar atl3lrition to the strategies that seem to prpmdte 

^- ■ - . ■ ■ ^ ' • t ■ ^ 



the benefits and avoid the, problems . 
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SOME OTtlER I^MISING ' USES OF HUB 
FOR. PROBLEM FORMULATION 



• Use of tM program workspace to^compare alterna'tive. "atructures" of 
the problem situation.. There are a wide range of general-purpose/.' 
modeling paoXages (such as KSIM, ISM, ASSESS, among o the r^)* that can 
be used to develop a structure for the^ problem situation. Rather 
than explore different variables and values for vatiaiiles, as was 
described in Scenario 1, a group might select a limited. set of vari- 
ables and use those variables- in a variety of diffferent structuring 
programs. Discussi9n would focus on the different relationships ' 
that mi^ht eiiterge Using these different programs, . v . 

• Use of the PLANET conferencte to identifti issues. ' .The initiaL defini- 
tion and structuring, of /a problem often invol^veq the' input from a 
number of professionals. The PLANBT^ Conference- provides a way for 
people who arb geographically separated, or who are unable to meet 
simultaneously,^ ^o generate issues and structure relationships among ^ 
variables. . * ' .s 

• Use of the program workspace 'to teat' model st:pucture, The'progriim 
workspace^enablee model buiXders to ^st working sub-components of 
the model, to relate , results to the postula^:ed problem, structures , 
and to test the sensitivity of changes in parameters. It is possible' 
to comnent and assess simultaneously as the model undergoes changes. 



V 
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SCENARIO 2; SPEAKIHG WE SJVME lANGUAGas ^ ' : * * 

There are lots of reasons for building a model j to provide assistance 
ix{ planning, to develop* skills ;Ln conceptiializing a oon^pl^^x problem, to in- 
fluence the way others see the world, to explain phenomena that have not pre* 
viously been expl^ned. All of these reasons suggest the need for some com- 
munication, even though coOTnunicatibn may not be the primary motive for the 
modeling effort. , ' " * 

Iiqproving /communication among the principal actors in a s.itua^tion may, 

howey^er, be a focal reason modeling, The modeling process forces par^ 

>j * 

ticipants' to make some of their assumptions eUtX)ut the world explicit. In 
simplifying reality/ as all modelp must, the participants point to those 
eleihents which seem most important; to them,,.. In /assigning values to variables 
or preparing data for input, they get a more detailed understanding of how 
each of them is viewing the world. By running the modAl with different 
values for variables, they come to understand ho^ inportajit or unimportant , ' 
diff fences in perceptions about those values are to the outcome. And by 
Jointly working on a common^ task, they provide at ledlst a foundation for a 

^continued working relationship beyohd the modelihg effort, 

* * ■ . 

At the same time, the key actors probably do not have the,skAlls to 
build a model themselves. If they hire a grou]^ of modelers to build jthe 
model, chances are' that a lot of those decisions which shoulcj provide the 
basis folr improved coiwnunication will be made by the itodelers and one or 
two of the actors who are vmrklng closely with the modelers—or sinjjly by 
the /htodelers themselves. Furthermore, *the group might tl)en be asked to 
••buy into^* the model without really knowing what it Is br why they should 
trust it. As a i^esult, the mode ling, effort actually bftoomes a barrier to 
the comjiunioation process • 

HUB could hel^p 'this situation in several' ways I it could be ucy|^ muoh 
tlie way we detcrjObed In Scenario 1, in the problem formulation stage, using 
general^puxpose modalirtg packages. It could also heljp by providing 'Improved 
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docunentation, as will be described in Soe/iario 3.^ But a real i.rmovi^ion in 
^e modeling process might be to' make the'^tire model much more interactive,' 
leaving toom for the key actors to' make more decisions as the model is run- 
ning. .in fqrm, such a model wou;Ld be like a simulation game, except thiit * 
the "players" would have much more control over the rules and much more know^ 
ledge of the roles than in typical simulation games. This promising use of 
M\Sh might unfold as follows! 



The situation is this: two' divisions of a cxyrporation a^e examining the. 
possibility of sharing some of their resources. Including warehouse space, 
transportation facilities, and data processing services.^ While upper manage- 
ment believes that such a change would result in lower costs and reduced 
* energy needs, they also anticipate a^ lot of resistance from middle management. 
Thus, they have hir^d a team of analysts to develop a model to help them plan 
for the new system. Asguming that the middle managers will be more enthusi- 
astic if they help plan the system, upper manageipent askg the team of analysts 
to Involve fobr key managers from each of the divisions in the process. 

This is the way they might use HUB:, the team develops an Interactive 
simulation in two stages. The first stage models ^the existing systems in 
the two divisions. Each manager is consulted in a face-to*-face interview in 
this process, and the progress of the modeling effort is reported in a PLANET' 
conference to which all of^the managers have access. The resulting two ' 
models can be exercised by the managers. The exercislTnq consists of- runnlpg 
each model in a program workspace; since the managers ark online at the same 
time, they /pake decisions ^individually or in teams, at various poihts in the 

» f 

program rim. Discussion focuses on the results of the ru/is and the alloca-- 
tlon of declsion^maklng responslbilljbxj . 

The second stage attempts to ntodel the conversion process. The model-- 
ing team*and t{|e managers dcf this jointly. As the managers of one division 
make decisions that affect the operation of It/ie other dlVialon, the model 
builders begin to construct links that describe the. effects. This la ac- 
compllshed asynchronously over a period of several we0k3. The re$^lt is 



a third modal that represents a cojfnbined system and that pan be exercised 
much the way the firlsit set of models was, only with all managers partici-- 
pating together. Here, t/je discussion focuses ofi^ unforeseen problems, and 
opportunit^ies as well as on the identification of areas in which cooperation 
or clarification of responsibility and authority wilX be neede(^. It eil9o 
provides an hverview oi the types of debisions that each ot them must inake ^ 
that they would not normally anticipate. Based on this * discuss iotl , -the^^ de^ 
velop a set of recommendations regarding the^best procedures for Impleiheiftr * 
ing the changeover. \ ^ ^ 



> - • . # 

. HUB provides a imique and fxuidamental advantage for this ki,|id of model- 
ing effort — the ability for a groi:^ of geographically separated people to 

I, 

interact with a program. This easy-to-use interactive Cfipability means that 
joint human -computer simulation of a process is encouraged. The human 
players can thup become participants dn the formulation of the model/ with 
a better understanding of the model's assumptions^ as well as each other's.' 
Hae model builders can construct th^ model on the basis pf the kinds of 
decisions the humans make father than; predefining the kinds of decisions the 
modW can deal with. In dhort^ it is a very different way of doing modeling. 

Beyond this ability to involve the decision-makers ii> the modeling 
process, HUB creates an environment in which a group quch as our fictitious 
man«igers can leaxia not only about the system being modisled, but about their 
relationship to the system being modeled. They can see who is called upon 
to make decisions, the^kinds of decisions they need to make, and even the 
motivations for those decidions. Hiey can see the relationship betv^een 

their own decisions and those of others. And since all of this occurs in a 

,'t, « ^ 

context of grotip conmurtication, they*can discuss what is going- idn. 

(The ability of HUB to support communication among geographically sepa- 

rated people is, of course^ fundamental since, in this scenario, we have 

♦ 

actors In at least three separate locations. 
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HUB'S ability to typport both synchronous and asynchironous communication 
is also inportant in this ^cenario. We expect the synchronous model to be 
ideal for exercising a simulation model with a group of, decision-»makers; in 
a very short ^me> they Can raise many of the issues regarding the operation 
^ of the system and their own decision-making processes. At the same time, • 
the asynchronous mode is critical to the model builders,' who need Uifie. be- 
tween decisi:ons— or runs of the developing njiodel--to construct and modify 



the model « # 



This time flexibility could be a problem, howeve^. It would be easy for 
..managers 6>.lose interest in the process if several days 'and much discussion 
were to com* between their decisions apd the computer' s interpretation of 
theif inm^ts^' And since the computer doesn't beckon them when it's time 

for a new cfeqi^jUwi^, they may jiast not come back. 

■ •■ - ■ _ 

Another probleA might arise from the game-like quality of the modeling ' 
process. A modfil can never matph the real world in c6n\plexity; thus, the 
simulation could appear oversimplified, and the managers might not take it 
seriously • They might even feel that it is undignified and be reluctant to 
participate. Alternatively, they might "play the game," but treat it as a 
^ game and not make decisions that are representative of their decisions in 
real life. In either case, it» is important to disOuss those parts of th*e* 
model which seem overs !bt^pilfied ra^er than letting the group ignore them*i 

0. ^ ; . 

The dynamics of such a modeling process wiU inevitably reveal a lot 
about the interpersonal relationships among the managers,- arid some of these 
relationships may need JLmproyemei).t. -rtiat is, after all, one of .the primary 
" . purposes of the exercise. However, the managers may be reluctant to address 
these interpersonal issues in the presence of an outside team of analysts. 
Perhaps even wo^^rse would be a temdency to use the modeling team as process 
^ ''^x: consultants: npst modelers are hardly qualified to assume such a rolel 



Finally, while a simulation game is less threatening than a formal meet- 
ing, it can -still be threatening if the managers feel that they are somehow 
being tested, partiovdarly in ^e presence of their peers, if the exercise 
Is to promote conimunlcation among them, then, someone is going to have to 
do something to establish an atmosphere of trust. 



SOME pTHER PROMISING USfiS OP HUB ^ 
FOR PROMOTING COMMtOulCATION 




♦ .'V ■ * 

Use of a program workspace to ^promote communication amongr 
experts in a field. A group of ^xpertrs couid be invited to 
'exercise" one or more modela in a program workspace •^'^^^le^ 
runs would emphasize alternative values for variables , with 
discussions of the astouinptions under lyi^ng .those values, vihile 
the actual model rtins might yield some insights -about the 
sensitivity 6f the model to altertiative assuit^Jtions about 
values f6r the variables ^ the real major objective would be 

to increase the experts' vinderstanding of one anothpr's assiimp- 

» 

tions and world views ^ and perhaps to encourage some laynthefiisl 

Use of PLANET and program workspaces to promote communication 
between the model builder and the client. Tfte HUB system might 

be exercised much as just described. A newly developed model 

• ^ . ' . \ 

would be exe^oised by a, group of es^erts, together with the 

model builders and the client. Such a use would (1) allow 
everyone to discuss the alternative values foi: important vari- 
ables; (2) allow the gpoup to test the aengitivity of the 
modelr to^^atiations in values that are particularly interest- 
ing* to the client;, an^ (3) provide tfye client with a critique , 
of the model by th^ experts. . ' ' 

y: * • ' 

Use of the program workspace to train future users of the 



model, the model is to be run andymaihtained by a group 
other ttfan the model builders, the pipgram workspalce qould be 
used to train thes^ ufeers. They cquld participate in trial 
runs/ with the builders observing and commenting on their runq 
as appropriate. This prftcess might also suggest particular 
docUment/ition needs 1;hat might have gone unnoticed. 



9 



SCENARIO 3: WE^VE GOT PEOPLE DIGGING 
THE RIVER FOR CLAY 12 WATCHES A DAY I 



One of the most disappointing failures of large-scale computer models 
has. been their! lagk^of impact/on the policymaking[ process* This failure has 
ma|^ possible causes « But the one that .is cited most frequently is the lack 
>f adequate -documentation, * 



Hie proposed solutions to this problem have been sts^ndards and disci- 
pline. The Department of De£er>se has answered the call ^ for standards by ' 
producing a lengthy vblume of specif ifcations for the documentation of com- 
puter pr^rams. Since people are wary <Jf ^he natural ability of ftiodelers 
(or anyone else) to exercise self-discipline, it has been proposed that one . 
or more membez;s of a modeling team be* included solely 'to doctment the ieffprt* 



It seems ,c3iear that many modeling projects will not take such a formal 
approach to docximentation. In f&ct, such an approach to docvimentation mi^t 
conjure up a scene in a recent science-fiction sppof of con\puters and commur 
nicatlon technology. In it, hoVelist Rob Swigart transports us back to the 
days of Gllgamesh in Sumeria and suggests some of the problems that Gllgamesh 
mi^t have had meeting DOD-like specs for documentation: 

"I look glum, huh? j»ell, I am glto. You got^m^ started on this damn 
recordkeeping and filing and listening to oonqplaints and all the rest 
of this stuff, and frankly, I'm. going nuts. The gods hate me and 
won't talk to me anymore. I haven't heard a thing from Lug^lbanda 
since last week. I spend all my time reading these damn re|)orts« jAo 
much barley liere, so much wheat there, so many of walls built. Wo 
many es fallen down, so many lAu of grain planted, so ma|^y harvested, 
V so many spears and bows and arrows and helmets ix\ thQ warehouses # so 
many es of canals broken <lowr^ and not repaired, so much grain ealben 
by ratSt Do you- real iee that since we started this recordkeeping, ; 
the scribes' have filled four huge rooms with clay tablets, and that's 
tliis monjii alone\ And here" ~- he waved his ^Ibow at the litter on 



*See especially Saul I. Gass, Compxxtet Model Documentation t A Review . 
Lmhd an Approach^ Univetiity of Msryland, Cbllega of Business and ManageAisnt, 
^rll 1978- 



the table. "Notes! I use v^) tons of clay just taking notes. I've • 
^rot people digging the river for clay twel^ watches a day, sunup to 
smvp, and we still can't seem to collect enough clay, it's awful; 
' Ouchl" He had put his elbow down on a jagged piece of clay.* 

* * * . ' 

Modelers don't have to worry about acraping t^eir elbows on a jagged piece. 

of computer code, but they do need tb keep documentation efforts from ryii- 
ning away with the modeling project. Our third promising use of HUB concerns 
this ne^d.^ » j ' 



The situation is- this: a team of four ls,building a model that involves 
an extensive regression analysis to develop a set of equations for forecast- 
ing future patterns of use of national- forests . In^all, they will ■ prohaffly 
need over 75 "runs" of the regression program,. Different members of the 
project team will be making the'runs at different times. They will need to 
keep track of who has run the program, which variable combinations were 
tested, what the results^ were, and what new runs the results suggested; then 
they will need to record this information for the client and select and 
label the significant .runs for an interim report. Since all ^of the team 
members have, other project commitments and will be traveling off and on • 
during this process, they will have trouble keeping up, on a daily basis, 
with the progress of the runs; they will also have some difficulties dis- 
cussing' the results and next steps. And since they are hivnan, they are 
likely to become inundated by stacks and stacks of Computer printouts that 
are incompletely labeled or not labeled at all. ' * , 

This is the way tt^ey ,migh€ use HUB: j^fo activities are set up. .The 
first is a travel conference in^PlANET. This is used whenever one of the 
project team is traveling to coordinate the project or for general discus- 
sions about the regression analysis. The second dhtivity is a program work- ^ 
space in which the regression program can be run. The, group agrees to one 
protocol in running the program: that'at the beginning of ^ach run they 
will include a brief coiment describing the'run. Thus, whenever the team 



1 ' ' 

J^oh Swigart, The Time Trip, Boston; Houghton Mifflin Co.. 1979. 
pp. 151-52. ^ \ ' 
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members want to know the status of the regression analysis, they check irito ^ 
the program workspace, HUB indicates with an asterisk which runs they haven't 
aeen, and they review these runs, using the "COMMENTS ONLY" restriction, so 
\ I that they obtain a Hsting of the runs plus the initial comments that de- 

scribe the runs. For example: 

" ■ • * ■ 

Regression [23] Run by Smith 7-Aug-79 9:^30 AM \ 

[Comnent 1] Smith 

This run will concent;rate oriith^varlables DISCRETIONARY INCOME and 
OIL PRICE. Tbpy will be foroSoIn thfc f I rst regression step, and we 
cajk see what r squared results. It wM 1 also be Interesting to see ^ 
the order In which the other variables are chosen In subsequent steps* 

' or m ' * 

of course, they sometimes also want to see complete transcripts of kom^ of 

♦ 

the runs and 'comment on them. When all o^ the regressions have been run, 

one project member agrees to document the work. Using the document work^ 

space, she prepares a bfief report outlining the approach that has been taken 

and the assumptions underlying it* She includes an overview of the regression 

runs and the conclusions that have Jbeen drawn from them. To this report she 
\ . ^ ^ 

^appends a list of all runs with comments and the entire transcripts for the ^ 

10 critical rur\s. The report is then copied an^ placed in notebooks for a 

face-to- face meeting with the client before proceeding to the next step. 

* 



HUB seems promising in this situation for several reasons. The^ first 
is that it tends to^ capture documentation informatJbn at the time of the 
run* The user has to enter the HUB program works|j|ee in order to use the 
program. Conine nting on the run then involves the same kind of behavdor as 
running the program-- typing at the terminal ^ waiting for proinpts from the 
system, and responding*. Documentation becomes a more natural extensiion of 
the run itself and is thios easier; it is also more likely to^ capture the iro-» 
mediate thoughts ot the person doing the run, rather than requiring that the 
user teconstruct them minutes, hours, or days l^ter^ PlirthetmDre , this in- 
forttja'tiion is juxtaposed to the run — or even the portion of the rui— to which 
it refers • . 
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HUB also captures some- information automatically*, »vej;i"lf th^Mwer doee 

not provide comments, captures the run transcript* Itself,, together with 

the time and date it was run as well as the name of the'pe^rson who rin it 

and a run nutfcer. It thus provides an autoi^jitiq filing system, from which - 

transc»ipts can be retrieved by* date ^ by number, of by author 'name . (It is . 

also possible to retrieve by keyword if thaf la appropriate'.) 

(' .■ , . 

The same features that provide this easy-to-acoess transcript file also 

make it possible to obtain a quick overview of what has been done and by 

I ■ 

whom. This makes th^ system a useful management tool as well as an aid in 
preparing suntnary docunentation for a client, as suggested by the scenario. 

Finally, HUB provides a document workspkce in which reports can be 
prepared. Here,^s in the program workspace,^ there is emphasis on group 
Interaction and collaboration. All group members can comment on a document 
or edit it and ejcplain their changes. Each time a teer enters £he workspace, 
all changes that he or she has not seen, along with explanatory comments , aire, 
automatically displayed. 

Now, what could go wrong? Obviously, us,ers might not be motivated 
enough^ to meet even the minimal reqxilrement of one comment at the beginnirig * 
of the run. In some case's, they might ^even choose not to store a run (this 
.is possible in HUB) because they feel it was insignificant or perhaps con- 
tained §n error that was em)5arrassing in some way. Information would cer- 
tainly be lost *ln. this case, but thfe loss i,s no more likely to occur than ^ 
in traditional ways of rimning programs and documenting runs . 

The situation could, however, be worsened if tl^ system led to misin- 
formtion rather than iust the loss of inforsjation. For exaflple, if coinnents 
were. not clear or not adequate or i£ there were unrecognized misunderstand- 
ings- about the terms being used, misunderstandings about the analysis itself 
might result. Spme runs might be dt«)licated, while others might be omitted.- ' 

Or the wrong run might be selected for consVructing the equations, Ihis 

♦ 

situation would be even more troublesome if the group placed t<>o much faith 
in the "systematic" quality of ^the HUB process. ^ 

Also, the group might be seduced into placing too much confidence In ' 
the ability of HUB to capture tht really important ooromuhication about the 



runs* In f^ct, the most i4Bportant discussions— -the ones that lead to 
declslons-^are likely to occur face- to- face or even/over the telephone • Hi is 
okay*. No pne e^tpects^modelers to take up permement resl4^ilce In HUB. But 
. if moa^leirs think that they are automatically gathering_a|l of the important 
iftecisipns, fthey may neglect to riacord some vital information outside the 
system^ ^ ' . 

Finally, we can speculate that all of this' recordkeeping mi^t make ^ 

some members of the project team a little nervous, a little resentful, or 

both. After €lH, if one person has done more than two- thirds bf the runs 
» 

when the workload is supposed to be shared equally , the inequities are going 
to shpw up. Differences iri skill levels may show tp, too, and discourage 
some people f rom*participating, . JEn such cases ^ HUB may inhibit comnunication 
more tham promote it. ^ . 



OTHER PROMISING USES OF HUB 
f6r /DOCUHj^JI^ON 



Use of a program workspace ae a personal workbook for exercising 
a program or model or for developing a progiam. . The use would be 
sindlar to that outlined in the scenario just described, except 
that it woul-d be a |)erqonal record rathfer *han a gxx^p conference. 

Use of the document workspace as a pejtsonal notebook./ Each ropmber 
of a modeling team might waht to maintain a set of personal notes 
about the project. . - These notes might »in(?lude questions to be 
raised, ideas coi^eming \ater stages of the project, and the kinds 
of notes. pne often jots down on the backs of envelopes durfng the 
course of a research effort. • , ^ 

Use of a PLANET confei^ence by geographically separated members of 
a project team to documenp assumptions about the model, pie PLANET 
conference might be used to cohduct a general disicussion of the 
variables and their relaUonships as well as other models of the 
same process. The conference organizer could then analyze the 
transcript to identify assumptions, -fliese coul^ be lilted for the 
group to comment on explicitly, with revisions, they could be in- 
cluded in a report to the client. (The client might even' be< in- 
cluded in si;ch a conference.) ♦ ' ^ . 

Use of the document workspace to write, foodify, and annotate code 
and to document asalSmptions made by programmers in the course of 

. implS^menting a . moduli Since the document workspace is designed for 
joint editing, it may actually encourage jpint progranming as well 
as a record of changes in the code, togetheUtr with reasons for those . 
changes. Often programmers realize that they have to make some 
assumptions that were not specified by the modeling team as a whole. 

^As these occur, they can be noted in the ccrde, and memos can be pre- 
pared for group discussion. 



scenario' 4: THE EHPIRICXl l^CNK 



HUB is first and foremoat a coirmunicatipn environment* But it is also 
a laboratory in which , experiments can be conduCte<J----experiments in mordeling 
methodqlogy* With its cj^pability for structured group cftnmianication and its 
automatic recbrdkc^eping capabilpjltes^ HOB provides an;i<Jf€(a?- setting for ex- 
pioring eoypirical appi:oaches to some of the problems that confront mpdelilig 
today. ' . • • . . 

An exanple is the linking of sxjbmodels. This process, which is one of 
the critical issues in Jarge-scale mq^^ting, can be viewed as a process of 
building coninunication channels among the' submodels. The effectiveness of 
the composite model will' depend on the characteristics of these channels. 
Some of thes'e characteristics will be technological: How is the information 
transmitted? How qi^ckly? How frequently? . Other characteristics of the 
communication channel are more cultural. When* the out^tut of onW model is 
not exactly what is required as input to another, then interpretation of the 
output is required. How is, this done? How does it dep||r|d on the background 
and Hiews of the person pwho is linking the models? Thp,way that these 
questions — both technological and cultujral— ^are answered in linking submodels 
will depend on three con^derationsa 

• First, vthere are theoretiqai conaideratiqr]^. A good exaiqpi® ia thf 
questioh of how a tim^dependent model should ipgiqally ^^ 
to a static model. ' . * .\. -..rc-.Mfj^r. ^^i-'J^ 

m Second|» there are software considerations. Software oho ice 9, f 02: i\ 
the individual models wilt inevitably oonstrain thp type or 'l^SnK, 
that is constructed. Software capal^ilities, in gene^alf will shape 

^ bot^ the. technological and cultural characteristics of the cfommuni** 

• . ■ ~ <• 

cation channel. ' / 

*■ ' . ^ *• 

■m Finally, there are ^interpretive considerations « When no automatic 
link existf between a pair of submodels, a user^oiE' the model must 



lnt^rpret»the resuXta of each ih th^^lj^ght of the other, ohis is , 

^ ^ highXj^Wectiv* process, which vAriea from u*er to xiser. When < 
the eoiraiiunioation channel is- oohstructiBd^ it myst provide some means 
for this kind of 'selection and interpretatii^n." 

The HUB environment provides a particularly good opportunity , to examine 
the interpretive pltoaess eire>ij;ically and to .consti^ct linlcs based on the 
results of this obse^aiion. itie foi;.owing scenario suggests how suc^ an 
empirical Approach to-'linking submodels might proceed., 

• • ■ '■ V 4 ' ■ 

• * . . ... •• . ■ • • 
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This is the situation: team of modeler^, socUl scientists, ihd con^' 
puter scientist^ is working on an experimental project to develop f method- 
ology for linking submodels. They wa^t to\se an empirical apprJfch, observ- 
ing how different groups -of h^uman users of^the models interpret My niches ize, 
and use the dpformation in various submodels and then 'identifying jprocedures 
for doing this autfimatidally via computer. # * 

This is the- way the^ might use HUB: the team establishes^ several ^o- 
gram^ workspaces. Each^ok the,se workspaces includes tWo or more submodels 
(of varying complexity) that are' to be linked. The tests involve use of 
the sitbmcfdels by a variety of differ ent subj ects^who range from lay people 
to social scientists and' experieffced modeleT^T^'^TTr-^Q^ test, one or more 
people are^^irst briefed in a PLANET conference. ^h'ey\ are given problems 
to solve ,that require usingt> inforfoat^on from all of the submodels in the 
workspace^. Sometimes the tasks call for using information from one or more 
submodels in running another, but this integration of models ^may require 
considerable ingenuity and interpretation.' 

The analysis of' thfi tests includes: (1) ixsing the NUB interactive 
monitor to trAck the ^ low of information, (2) content analyses of tran- 
scripts of pie rQns in the program workspaces ' tp find oOimonall ties und 
dlfferentea in the way the subjects approach the problem, and (3) direct 
questioning of aUbjectia as th^ are runhiiig. the program to discover wh^ they 
mk9 thq choices th«y do and how they perceive what thipy are doing. 'Th6 ■ 
.pi)j«ctiv*;i« to oisorve 6?ie type» of operations the human ^linki^ perform 



in transferring int'ormtion from one model to another air^d therSby to arrdve 
at aojalie understMdin^ of^ wb4t P^rt of that!^ process can be automated and what 
rules should ^uidte the aatomation. 




HUP pKQyides:.two distinctive benefits for this kind of experimenta 
with jnodeling inethpdoldgy t 

Firsts it allows thfe research teeun to structure the experimental set- 
ting ^ controlling access to resources and providing the same information to 
all of the subjects At the same time, this stJOnicture is easy to use; thus, 
differences in the accroaches of different subjects will have less to do 
with ^JjJLllQ in using confute r programs them, with their 4^ffcfrent perceptions 
of the problem and the ^possibilities £or solving tho^e problems.- 

. Even more critical t$> the experimental jetting are HUB*6 capabilities 
for monitoring the flow of information among partl|cipants and programs in 
the workspace; its automatic recordkeeping capabilities that. provide complete 
^records of the suJb^tance o^f the^ information exchange; thef^ opportunities for 
unobtrusive observation, so that the researcher a^ cariL^ ote stabtleties that 
may not be captured by the transcripts or monitor data; and thd di^portunity 
for obtrusive observation — that is, to interact with the siibjects as they, 
apa performing the assigned tasks* 

The ptobleros yith the HUB environment ^ure inach the same problems < that 
oocur in any experimental setting. First, the tasks and setting are artif i-' 

*cial; the approaches to solving the problems, and the coumtmication patterns 
in particular, art likely to be somewhat artificial also. If th.e experi- 

'mianter's purpose is to identify" the cultural coifislderations in linking siih^ 
models (or any other irfbdeling problem), he or she should be awa3:e'^hat the 

'IS^ system changes the culture of the subject. 

,The observation pa(^abllities that art^ a benefit to .the experimenter 
are also a possible IlabjLlity. Subjects in .all lytperiments tend to perform 
for the observers;^ And even though the observers may never interact with * 
l^he subjects, HUB is always iretiiinding the sub fchat somfone is or is - : 
not prevent. 



Finally, the HUB anvironnent may- itself constrain the possibilities for 
the way the subjects transfer infoixnation from submodtae ^ submodula.. The 
program workspace. does not giVe them access to the full power of t^e com- . 
puter—power that cerUinly would be available to the modeler or conputer - 
programner oonstructirig a link. Thus, the human linking processes obseiKred 
may demonstrate the way that mpdels can be linked in HUB mfcre than the best' 
way to link models. t s 
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SOME OTHER 'promising OSES OF HUB w > 

" FOR EMPIRICAL DEVpipPMENT OF MODELt^G METHODOLOGY 

A. , , * , ... 

I M . . ■ t , . , , , u. <t I I ■ . — — , — , — I Vi ^ — ^ — , — - 

*j , ' • . • ■ 

t Uae of the program workap^ce to develop a representation of a complex 

' . * ' 

deciaion^making process. A pr^iminary rooiel program might be run in 

a progreun workspace. One member of the modeling team (or test silbjects) 

would run the program^ suspending it at various points to ask for in- 

formation and to make deci^ione* .Other members of the team mi^ht then 
* * s ' • 

' «malyze these deci3ions in terms of the points at which the degision- 

maker* stops; thfe model, the types of information sought, and the complex- 
ity of the decision. This^ analysis would guide them in formally repre- 
senting the decision-making process. 

• ^Use of the program workspace to test an "Intelligent'' model. There 

has been 9dme work to include in simulation models a representation of 
an "intelligent^' jpolicymaker's perceptions of the world and his or her 
creative responses. Such a model might: be tested in a program work- 

. space. The model *could be run Vith different configurations for the 
perceptual/problem7 solving module. The performance of these various 
configurations could then be compared J:o thtit of Jl) an individual 
human actor presented with th^ same- information; (2) a group of human 

^aptjprs; and (3) a group of human actors ^o have fceen given specific ^ ^ 
political or bureaucratic roles to guide their decisions. 

• Use of thi^ program workspace to Analyze the strudture of a motfej. A 
model program could be included in a program workspace with a series of 
programs that detect and analyze thi* structural features of the model. 
F*or exanple, one program might analyse the strength of every feedback 
loop in the model; the group could then discusrs i^heth^f or not these 
loops seem plausible, and represent mechanisms .that eai^ be .explained in 
the real world. If not, they ahtx "mock vp" changes in the model and 

.test the new Structure. 




Modeling Choices; 
A Framework for Evaluation 



This report has outlined some uses of HUP that we^think ape prondsing.* 
Hiese uses range from c»ies that are immediately and practically attractive 

4 ■ 

to ones tha^ are more exploratory and require some rea^^isk- taking^. They . 
^11 reflect what we believe to be the strengths of the HUB sjistem for the ^ 
modeling process, ' « r ' I 

Over the next two years, we will be testing HUB in field settings* We 
hope to have th^ opportunity to ofDserve its use in situations, like those 
described in the scenarios. But we alldo recoefnize^ that there may toe other 
situations in which HUB is as useful or more • useful > To evaluate these ' 
situations, we i>eed to place them in some framework^ to locate th^ on a 
kind of mAp of the modeling world, ^ ^ 

How do we draw such a map? What territories would it span? What lines 
mark its boundaries? ^ * < 



in 



Many ajpproaches to evaluation are available to us, from both the hard 
and soft sciences. However^ our particxilar trfsk— facilitating communication 
in a gro\At> modeling context— inclines us toward the evaluation methodologies 



the softer sciences. 



Qne promising approach uses a systems framework to capture the essence 
olf*the modeling process.* By matching the characteristics of flOB with* a 
'given modeling task, we are able to determine the kinds of modeling efforts 
most likely to benefit from the HUB approach* . ^ ' 



*Seb P. B. Checkiand, "The Development of Systems Thinking by Systjeme • 
jPractice— A Methddoiogy from,, an Action Research Program," Progresa In Cyber- 
netic9 and SyB terns Reaekrch^ vol. 2, Uemispti^re Publishing Corp. , 1975 1 
Ch6okland# ^*A Systenis Map of the Universe," Journal of Sya terns Engineering , 
vol. '2, no. 2, 1971; and Checkiand, '^Towards a Systems-^based Methodology 
for Rsal^,World Problem Solving," Journal of Systems Engineering ^ vol. 3, 
no. 2, 1972. 



As a preliminary stop toward building 8uah a systems framework, we ask 
again the three questiohs suggested at t^« beginning of the second chapter: 

^ What is being modeled? ' * * ' 

Why is it being ^modeled? 

How should it be modeled? . . 

The range of responses to these qufestions constitutes* a taxonoi^y of choices • 
in the modeling proQfess. When ea^janded, the questions provide a systems 
evaluation map of the modeling task. , . 

In exploring what is being modeled, wer will want to examine the modelers 
perceptions of the problem being modeled. Obviously/ the modelers themselves 
'may npt be in unanimous agreement. To represent these perceptions in .terms 
of our systems framework, we must determine: the goal or goal^ of the model-* 
ing task; the structure of th^ problem spape ; the activit*ies or functions 
within that space; and the control or* management dimensiona-of-the-^roblemr 

It is important to deterridne-the final purpose f or end use, of the ' 
model. The expected end use will affect both what sort of information is 
emphasized during the modeling process and how it gets transferred among 
modeling participants. End uses generally fall within ond or mor^ of the 
following categories: exploration or explanation of pherJtmena, prediction, 
planning, learning and teaching, anjS methoddHogical developtaent . 

The crux of the Victual modeling activity is' how it should be carried \ 
out. Much material is" available in this area, and a ^reat number of protcr- 
cols have been Suggested. Our aim, during this evaluation process, is to 
suggest and enumerate the muUitude of decision choices. open to the n»deler. 
Some of the issues tiiKt would be considered here can be, found in the systems 
evaluation map^'in Table 1. 

The framework we have outlined is certainly not a Complete ifaip of the 
modeling "space." But it begins to define a range of choices in the model^t 
ing process that m*y pv may not be well suited to the HOB environment or 
that maV affect the way that Hl^ is used in the modeling process. As we 
test HUB, we will be expanding and'' refining this map. We will try to lo- 
cate both successful and unsudolpssful used of HUB. W^\ill try to identir 
fy choices that seem to be critically linked to HUB. Through this ^V^t^ 
tion, ^ hope to be able to answer the question that .opened this report r 
What should we * with HUB now that w«'ve ^t Tt? 



TABLE li A SYSTEMS EVALUATION FRAMBWO|tK 



MAT |8 BKIWO HODBLED? 

this oittogor/ conc^ims th* nod«l«r*« p^roeptlons 
of th« system iMlng wodmlmd, perceptions that 
■i^t b% organixfd «ocording toi 



• Structure 



• ocN^ltx or siiiple By^tmm?. 

9n ill*»<tefined or well«*dafin#d systam? 

a changing or stable system? . ' 

e Goals 



to^MinUin stability?^ 
tq iMscimiae order?* 
to BinimixM order? 
to approach some **nitural** end?.. 




iPtions 



single or inult4.ple functions? 
eysten-*definii[ig functions? 
sy^ten-dependent fundt 



sns? 



• Cohtrpl, 



. contrblled by internal forces not subject 

to change?- 
oontrollad by a few critical external 

decisi^O points? ^ . 

, controlled by numerous ^ not well^^kncnm 

extental decisibn points? 



WHY IS IT fifiINO morJUD? 

Ttie expected end use of a model might be described 
in^ms oftone or morf of the following categories t 



• Exploration/explanfition 

* to explain phenomena? 

to identify causes of mdasix<)d aystem ^ 
performance? . \ 
to oidsritand operation of the System? 
to provide input to another model or 
analysis? 

e i^lanning 

to explore altematives? 

to ptadibt Idng'-term effects of decisioes? 

4^ to raiaa policy issues? 

* II * 

e Learning and teaching ^ 
« 

. ^ to Isgirove QOHmunioation among actors in 
a eltustion?, 
I to dayslop skills in dacision*^making in^ 
I oomplax syeteiiiii? ^ T 

' to laam to oonoeftualisa a doeplex eys^m? 
,to Influtnof pcaiaone elp«^s msiital modalt 



e Methodological developmint 

* to davalop a new modeling techniqua? 
* to test or demoni Crete a new modeling 
technique? 



' . 1^ s^ 

HOU 8h4uu) it be modeltoV ; 

Hodblers make numsrous choices about the way 
that a system should be modeled, including 
choices in the following categories! 



e Organisation « ^ 

multisitt or single site? ' 

well-defined division of responsibility? " 

team approach , iflexible division of 

responsibility? 
short-term or long-term? 

r ^ ♦ * 

e Comminication between btiildar and user 

continuous or intermittent? 
at beginning and end only? 
written, telephone, face-*to-*faca, 
^ ooiii>ute r*ba se d? « 
formal presentations? 
training? 

I 

e Com m unication among buildek^s 

^ghly structured or rela^vely 

unstructured? 
face-- to- face, talephohe, written, 

oomputer^based? * 
, [ graphics? 

e Software choices 



I ling language? ^ 
analysis packages? 
interactive or batch? 
. display packagas? 

/' 

e Hardware choices 

» 

local cotputar? 
iMtwork coR|>uter7 ^ 

a Itodaiing techniques 

/f 

nimmrioal? 

structural?. 

inputs-output? . % 

acon<>mstric? " 
ayatama dynamic? 
daterministio or probwilistic? 
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